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[57] ABSTRACT 

An image capture apparatus includes means for recording an 
image of a scene and means for recording audio information. 
The camera further includes means for determining that a 
request has been made for the recording means to record an 
image and means for ascertaining whether or not audio 
information has already been recorded for the requested 
image recordation. 

15 Claims, 3 Drawing Sheets 
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IMAGE CAPTURE APPARATUS WITH 
SOUND RECORDING CAPABILITY 

This is a Continuation of application Ser. No. 08/450, 
445, filed 25 May 1995. now abandoned. 

FIELD OF THE INVENTION 

The invention relates generally to the field of image 
capture, and in particular to image capture apparatus which 
also record sound. More specifically, the invention relates to 
an image capture apparatus which knows whether or not 
sound has already been recorded for a requested image 
capture. 

BACKGROUND OF THE INVENTION 

Cameras that record sound are known in the art but key 
issues have been overlooked: how to enable the user to 
capture sound conveniently, giving the user control over 
sound content and yet not interfering with picture-taking 
readiness. 

U.S. Pat No. 5,276.472 (the '472 patent), entitled Pho- 
tographic Film Still Camera System with Audio Recording, 
describes a camera that can record and playback audio 
information. In the '472 patent, audio information is cap- 
tured and reviewed by the photographer before picture 
taking. The audio information is then recorded by a mag- 
netic record head in the camera onto a magnetic layer on the 
film, following exposure of the corresponding latent image, 
as the camera advances the film to the next frame. 

Sometimes, camera users need to take a picture quickly 
and want to record audio information after picture taking. In 
this situation, with the camera disclosed in the '472 patent 
the recorded sound would be incorrectly associated with the 
following picture. Further, during the time required to pre- 
pare the audio data and write it onto the magnetic layer, the 
camera user would be unable to take other pictures. When 
camera users want to re-do their audio recordings, which 
happens a significant amount of the time, the film would 
have to be repositioned in the optical path to be aligned with 
the camera's magnetic write head for re-recording. This 
would also take the camera out of the picture taking ready 
mode. 

U.S. Pat No. 5,099,262 (the '362 patent), entitled Camera 
Having Sound Recording Function, describes an electronic 
still camera that can record sound, but cannot play it back. 
In this camera, there are two modes of recording sound, both 
following the corresponding picture capture In a first mode, 
the camera checks the position of a 4 'recording switch** to see 
if the user wants sound If so. the camera sets up a fixed 
duration 9.6 second self-timer. After the picture is captured, 
the sound capture begins and it continues while the self- 
timer is counting down. If the user wishes to record for less 
than 9.6 seconds, he indicates the end of recording by 
turning off and then back on again, a light and distance 
measuring switch. If he just turns off the light and distance 
measuring switch, the camera assumes that the recording 
should be aborted. During sound recording, if the user 
wishes to extend the recorded duration beyond 9.6 seconds, 
he may toggle another switch. 

In a second mode of operation, the user takes a continuous 
series of pictures with no sound. After the last picture has 
been taken in this mode, the camera checks the position of 
a recording switch to see if the user wants sound. If so, the 
camera sets up the timer for 9.6 seconds and records until it 
times out or until the user turns off and then back on again 
the light and distance measuring switch indicating that he 
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wants to end the recording. If he just turns off the light and 
distance measuring switch, the camera assumes that the 
recording should be aborted. This is the same ending pro- 
cedure as described above for the first mode. The above 
5 method of sound recording is complicated, thereby greatly 
reducing the k 'user-friendliness" of recording sound with 
pictures. 

U.S. Pat. No. 4.905.029 describes sound recording with 
an instant camera. Trie user interface for audio recording is 

i° not given in detail, but consists of the following steps: the 
user presses a button which enables sound recording and a 
5 sec counter. The sound capture proceeds until the timer 
runs out, then stops. When this sound recording is 
accomplished, relative to when an image is recorded, is 

15 unclear. 

U.S. Pat No. 4,983,996, entitled Data Recording Appa- 
ratus for Still Camera, does not describe the user interface 
sequencing for audio recording specifically. It states that 
recording is enabled by a switch and playback is enabled by 

20 another switch. 

U.S. Pat No. 5363,158, entitled Camera Including Opti- 
cal Encoding of Audio Information, discloses a camera that 
optically records audio information on a photographic film 
containing corresponding image information. The recording 

25 of the audio segment can occur either before, after or during 
the exposure of each picture frame. In a manual mode, a 
camera operator presses a manual mode button which causes 
audio information to be recorded for as long as the operator 
holds down the button up to a preset maximum time. Having 

30 to hold down a manual record button the whole time during 
recording is inconvenient 

In an automatic mode, the operator presses an automatic 
mode button after which the operator must enter a time 

35 length far recording audio. Recording of audio then com- 
mences when a picture is taken and continues for the time 
length set by the camera operator. Having to manually input 
a time for recording can be (a) difficult for an operator to 
estimate in advance, and thus inconvenient, and (b) distract- 

^ ing to the camera operator, especially if the camera operator 
wants to quickly record an image. 

In all of the prior art discussed above, which is incorpo- 
rated herein by reference, the camera operator must either 
make a number of difficult decisions, such as how long to 

45 record audio before commencing recording an image, or the 
operator is presented with arduous means of controlling the 
content of the audio recording. Such additional decision 
making when recording images and sound can be confusing 
and distracting to a camera operator. 

50 SUMMARY OF THE INVENTION 

The present invention is directed to ovetcorning one or 
more of the problems set forth above. Briefly summarized, 
according to one aspect of the present invention, an image 

55 capture apparatus includes means for capturing an image of 
a scene and means for recording audio informatioD. The 
camera further includes means for determining that a request 
has been made for the capturing means to capture an image 
and means for ascertaining whether or not audio information 

eo has already been recorded for the requested image capture. 
By enabling the image capture apparatus to ascertain 
whether or not audio information has already been recorded 
for a requested image capture, the image capture apparatus 
can link the audio information to the captured image with no 

65 operator input whether the audio information was recorded 
before or after the associated image capture. As such, the 
image capture apparatus is rendered more "user friendly", 
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These and other aspects, objects, features and advantages 
of the present invention will be more clearly understood and 
appreciated from a review of the following detailed descrip- 
tion of the preferred embodiments and appended claims, and 
by reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a back schematic view of a camera incorporating 
the present invention; 

FIG. 2 is a block diagram displaying the various compo- 
nents of the camera of FIG. 1; 

FIG. 3 is a flow diagram of logic and control used by the 
camera of FIG. 1 to record audio information; and 

FIG. 4 is an audio recording subroutine utilized by the 
logic and control of FIG. 3. 

DETAILED DESCRIPTION OF THE 
INVENTION 

It has been found that camera users generally prefer to 
have control over the starting and ending of audio recording. 
They do not like having the audio recording longer than 
necessary, as occurs in many fixed duration recording 
schemes. In this case, camera users feel they must be "quiet" 
until the recording time is up. Some camera users are 
concerned that they might forget to end the audio recording 
If something exciting has diverted their attention, so they 
also want a default time limit to end the audio recording. 
They also prefer to record audio information first, then take 
the corresponding picture. However, in instances where 
capturing a special moment must be done quickly, customers 
would prefer to have the audio information automatically 
initiated after picture taking or image capturing, as close in 
time to exposure of the image as possible. 

The camera operating system approach described below 
satisfies all of the camera user needs mentioned and the prior 
art does not The operating system is also advantageous in 
that many different users can intuitively use this camera 
without having to read a manual. Further, the operating 
system is simple and can be easily incorporated in camera 
products. 

In general, the present invention relates to an interface far 
a camera with audio recording capability to conveniently 
make audio recordings and to enable a wide range of use 
styles. Upon turning on the camera, the camera user can 
choose to take a picture or to record an audio snippet To 
record an audio snippet the user momentarily presses a 
record button to commence recording. The camera user may 
end the recording by a number of means including a) 
momentarily pressing the record button again to disable the 
recording when be chooses, b) letting the camera automati- 
cally disable the audio recording after a maximum default 
time period has expired, or c) pressing a shutter button to 
take a picture. 

At this point sound has been recorded but an associated 
picture has not yet been taken, so an indicator for this state 
will appear, such as an i-CT or a symbol on a liquid crystal 
display on the camera, to remind the user that there is audio 
in the queue. The user may review and even rerecord the 
audio before proceeding to take a picture. When the shutter 
button is depressed, the camera checks to see if audio has 
already been recorded. If audio has already been recorded, 
the audio in the queue and the picture are linked to become 
a matched pair. 

In the case when the user is in a rush to take a picture, the 
camera will capture an image, then automatically initiate 
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sound recording following the image capture. The end of 
audio recording can then be caused in any of the three ways 
described above. The camera user interface also includes 
means for rerecording audio information and playing back 
5 audio. 

A camera apparatus 10 shown in FIG. 1 includes the basic 
elements for capturing images and recording audio snippets. 
In addition to the typical camera user interface elements, 
such as a shutter button 12 and a viewfinder 14, the camera 

1Q includes a microphone 16. a speaker 18 and two user 
interface buttons 20,22. The buttons hereafter will be 
referred to as a RECORD Start/Stop button 20 and a 
PLAYBACK button 22. 
Also included in the camera arc a liquid crystal display 

15 (LCD) 24 for relaying information, such as the audio record- 
ing status, to the camera user. A pair of light emitting diodes 
(LEDs) 25. 26. adjacent viewfinder 14, may alternatively be 
used to relay the audio recording status to the camera user. 
LED 25 is enabled to indicate a "REC WAITING" state 

2Q which informs a camera user that audio information has 
been recorded but an image, corresponding to the recorded 
audio Information, has not yet been captured. LED 26 is 
enabled during actual audio recording to indicate to the 
camera user that a recording state is in progress ("REC- 

w ON"). LEDs 25, 26, or a further pair of LEDs (not shown), 
can be located in viewfinder 14 to relay information to the 
camera user when the user is looking through the viewfinder. 

The camera electronic block diagram is shown in FIG. 2. 
Operational control of the camera is provided by a camera 

30 system microcontroller 28. which can be a typical device 
such as the Motorola MC68HC05. User inputs 29 to camera 
system microcontroller 28 include shutter button 12, 
RECORD Start/Stop button 20, and PLAYBACK button 22. 
Outputs 31 from microcontroller 28 are fed to LCD 24 and 

35 LEDs 25, 26. Audio information is detected by microphone 
16 and fed into a sound recording subsystem 30 which 
interfaces with microcontroller 28. 

Sound recording subsystem 30 can be a digital audio to 
solid state storage system as described in U.S. Pat No. 

40 5.032,918; an analog audio storage subsystem such as the 
single chip solutions by Information Storage Devices 
(example chip #ISD2590); a digital audio to magnetic 
storage system as described in U.S. Pat No. 5.276,472 when 
used with a multirecording. non-volatile electronic buffer; a 

43 digital audio to latent image storage system as described in 
U.S. Pat No. 5389,989; or another audio data storage 
technology. All of the patents referenced in this paragraph 
are incorporated herein by reference. Sound recording sub- 
system 30 drives an audio signal to speaker 18 for playback 

so of recorded audio information. An image capturing or 
recording subsystem 27 also interfaces with microcontroller 
28. Image capturing subsystem 27 can be a conventional 
photographic film system or an electronic image capture 
system, both of which are well known by those skilled in the 

55 art and operate in their conventional manner. As such, 
further discussion of the details of image capturing sub- 
system 27 is deemed unnecessary. 

FIG. 3 shows the camera logic and control operation 
flowchart utilized by microcontroller 28 and detailing the 

60 user interface for picture taking and audio recording. In a 
first block 32, camera 10 has just been turned on (powered 
up) by the user. This can be accomplished by the user 
operating an "on/ off" switch (not shown), opening a lens 
cover, etc. The main loop control loop cycles through checks 

65 for user requests. At a step 34, a check is made to see if the 
camera user is requesting to take a picture by pressing 
shutter button 12. 
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If the camera user is not requesting a picture (has not enabled by microcontroller 28 causing sound recording 

pressed shutter button 12) the nucrocontroller proceeds to subsystem 30 to start recording audio from imcrophone 16. 

step 44 in which microcontroller 28 interrogates RECORD c . t . A 

Slit/Stop button 20 to see if button 20 haf been ™men- J?? h ** ^ ^™*°t°T^ ^T?* * ^ 64 

tarily aerated, thereby indicating the user's desire to record 5 ^ c ^ ™*<™*^* ^ '° *Z * ^ *™ UMr 

audio information. If the user has not momentarily operated haS "M™^ W** recording to be stopped. The user 

button 20. the nucrocontroller proceeds to step 50. If the user ^J^^ ^ recordin S niomentariiy pressing 

has momentarily operated button 20, the microcontroller RECORD Start/Stop button 20, If the camera user has not 

proceeds to step 46 in which the audio recording subroutine nianually requested to stop audio recording, the microcon- 

(FIG. 4) is executed to record audio informauon. After the troUer Proceeds to step 69 where microcontrolJcr 28 checks 

audio recording subroutine has concluded, the microcontrol- 10 t0 sec tf a maximum recording time (e.g. 15 seconds) has 

ler proceeds to step 48 where the "REC WAITING" state is elapsed by checking the watchdog timer. If the maximum 

indicated by enabling LED 25 and/or providing such indi- recording time has elapsed, the microcontroller proceeds to 

cation via LCD 24. After enabling the "REC WATTING" stcp 65 whcrc ^ watchdog timer is cleared and then to step 

indicator, the microcontroller proceeds to step 50 66 wnerc audio recording is terminated. The microcontroller 

At step 50 microcontroller 28 queries PLAYBACK button " t0 Stcp *1 WhCTC 4<REC 0>r stale iadicator is 

22 to see if the user has momentarily operated button 22 to M **P microcontroller returns to the main 

hear the last audio information that was captured. If the user P to &*m at step 48 or 50. 

is requesting playback, the microcontroller proceeds to step Returning to step 64. if the camera user has manually 
52 where an audio playback routine is executed causing « requested to stop audio recording, the miaocontroller pro- 
sound recording subsystem 30 to playback recorded audio cccds to step 65. bypassing step 69. Returning to step 69, if 
information via speaker 18. If the user is not requesting me maximum recording time has not elapsed, the micro- 
playback, the microcontroller proceeds to step 54 where the controller proceeds to step 70 where microcontroller queries 
microcontroller checks to see if the user is requesting shutter button 12 to see if the camera operator has pressed 
re-recording of audio information over previously recorded ^ DUtt0 ° 12 l <> request a new image to be captured If the user 
audio information. To request re-recording, the camera user is requesting a new image, the microcontroller proceeds to 
momentarily presses RECORD StartfStop button 20 and step 65. Ifme user has not requested an irnage to be captured 
PLAYBACK button 22 at substantially the same time. If the at rte P 70 - & c microcontroller returns to step 64. 
camera user has requested rerecording. the microcontroller The re-recording subroutine of stcp 56 in FIG. 3 is similar 
proceeds to step 56 where a re-recording subroutine is ^ to the audio recording subroutine of FIG. 4, but of course the 
executed to rerecord audio information. The microcontroller new audio recording would be replacing a prior recording in 
then loops back to step 34 to test for the next user input sound recording subsystem 30. 

At step 34. a shutter button actuation by the camera user's It should be noted that the camera microcontroller 28 

indicates the user desire to take a picture and causes the knows the picture number for each recorded audio "snippet" 

microcontroller to proceed to a step 36 where microcontrol- 33 regardless of whether a particular audio "snippet" was 

ler 28 causes image capturing subsystem 27 to capture an recorded before or after the image was captured. This 

image. If the user chooses to take a picture, the nucrocon- picture/audio correspondence information can be recorded 

troUer proceeds through all of the normal steps to capture an with the audio information, as in U.S. PaL No. 5 363,158, 

image. This may be a film exposure in a conventional film with the image, as in U.S. Pat No. 5 J 87,955, with both the 

camera, a charge coupled device exposure for an electronic 40 audio and the image, or separately, and allows the image to 

camera or appropriate methods for other imaging technolo- be associated with the correct audio information at a later 

gies. time without mix-up. 

At a step 38, microcontroller 28 determines whether or In summary then, the camera works as follows. After the 

not audio has already been recorded for the just-recorded camera user turns the camera on, the user can take a picture 

image by, for example, interrogating sound recording sub- 45 by pressing the shutter button or record audio by moraen- 

system 30, checking an internal control variable inside the tarily pressing RECORD Start/Stop button 20. If the user 

microcontroller or checking the status of the "REC WATT- chooses to record audio, a "REC -ON" is indicated to the 

ING" LED 25. If audio information has not been recorded, user during audio recording. The audio recording is termi- 

the microcontroller proceeds to a step 40 in which an audio nated by the earliest of a second momentary press of 

recording subroutine, shown in FIG. 4, is executed to record 50 RECORD Start/Stop button 20, the elapsing of a maximum 

audio information. If audio information has been recorded at time period or the pressing of shutter button 12 to record an 

step 38, the microcontroller proceeds to a step 42 in which image. A "REC WATTING* 1 state is indicated to the user 

the "REC WATTING" state is cleared by disabling LED 25 after recording audio and held until an image is captured. If 

and/or removing this indicator from LCD 24. The micro- the camera user chooses to capture an image first, audio 

controller then continues to step 50 and proceeds as 55 recording is automatically initiated by the camera following 

described above. the image exposure and any film advance operations (if a 

FIG. 4 shows the audio recording subroutine in detail ftlm camera rather man an electronic camera) to avoid audio 

When the audio recording subroutine is executed from steps recording of film advance noise. Audio recording is then 

40 or 46 (FIG. 3), the microcontroller proceeds to step 58 terminated by any of the three ways described in the 
where the audio recording subroutine starts. At step 59. an 60 previous paragraph. 

internal timer (watchdog timer) of the microcontroller com- The image capturing apparatus of the present invention is 

mences counting time in order to automatically stop audio extremely user friendly regarding the recording of sound, 

recording if the audio recording proceeds for a maximum The novice camera user need do nothing more than turn the 

duration. The microcontroller then proceeds to step 60 camera on and take a picture in order to record sound. No 
where a "REC-ON" state is indicated by enabling LED 26 65 other steps are required as in the prior art. Additionally, the 

and/or by providing such indication on LCD 24. Next, the user can rely on a default time-out feature or the commence- 

microcontroller moves to step 62 where audio recording is raent of another image capturing to automatically terminate 
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sound recording. Experienced camera users can also roanu- 2. An image capture apparatus according to claim 1, 

ally commence and terminate recording, if desired, but this wherein said first subsystem is a photographic film system, 

is not required. The present invention provides a great deal 3. An image capture apparatus according to claim 1, 

of control over audio recording, yet doesn't interfere with wherein said first subsystem is an electronic image capture 

picture taking. 5 system. 

The invention has been described with reference to a 4. An image capture apparatus according to claim 1, 
preferred embodiment. However, it will be appreciated that further comprising a third user interface element for request- 
variations and modifications can be effected by a person of playback by said second subsystem, wherein said con- 
ordinary skill in the art without departing from the scope of > £ programmed to perform: 
the invention. For example, a manually operable override , 0 iroiAa ,unncr / 

switch can be provided on the camera to allow the camera after running said second subsystem to make a sound 

user to disable all audio recording if so desired. All of the recording, checking said third user interface element to 

U.S. Patents identified in this patent application are incor- see if the user is requesting playback; and 

porated herein by reference. when user interface element indicates that 

PARTS LIST 15 playback has been requested, running said second 

10 camera subsystem to playback the sound recording. 

14 view^nder 5 * M capture apparatus according to claim 4. 

16 rakrorAonc wherein said controller further is programmed to perform: 

18 speaker checking said second and third user interfaces to see if the 

20 record button 20 user is requesting re-recording; 

22 playback button wnen second and third user interfaces indicate that 

2£ ^ re-recording has been requested, running said second 

25 2h leas . _ subsystem again to record sound. 

£ ^fo^ZTj " 25 imagelpture apparatus according to claim 1. 

29 user inputs wherein said controller further is programmed to perform: 

30 sound recording subsystem after running said second subsystem to make a sound 

31 outputs recording, rechecking said first interface element 
32-70 logic steps 7. An image capture apparatus according to claim 1, 

I claim: 30 wherein said controller is further programmed to perform: 

1. An image capture apparatus, comprising: durijjg of said sccond subsystem to make a sound 

a first subsystem for image capture; recording, stopping said second subsystem when said 

a first user interface element for activating said first ^ uscf intcrfacc dement indicates that the user of 

subsystem; sa | d apparatus is requesting said first subsystem to 

a second subsystem for sound recording; 35 capture an image. 

a microphone connected to said second subsystem; g ^ image capture apparatus according to claim 1, 

a second user interface clement for activating said second wherein said further is prograrnmed to perform: 

subsystem; during running of said second subsystem to make a sound 

a controller connected to receive inputs from said first and recording, stopping said second subsystem when said 

sccond user interface elements and to control said first 40 second user interface element indicates that the user of 

and second subsystems, said controller being pro- sa ^ apparatus is requesting that recording be stopped, 

gramme d to perform: 9. An image capture apparatus according to claim 1, 

checking said first user interface element to see if a user wherein said further is programmed to perform: 

of said apparatus is requesting said first subsystem to during running of said second subsystem to make a sound 

capture an image; 45 recording, stopping said second subsystem upon expi- 

when said first user interface element indicates that no of a ^ ^ 

image capture has been requested: 10 An image capture apparatus according to claim 1, 

checking said second user interface element to see if whcrcin ^ controller performs automatically when the 

the user is requesting to record sound; user turns on me apparatus, 
when said second user interface element indicates 50 n ^ imagc capture apparatus according to claim 1. 

that no sound recording has been requested, whercin mc ^ge capture is a single picture, 

rechecking said first user interface element; 12 An image capture apparatus according to claim 1, 

when said second user interface element Indicates wherein me controller, after running said first subsystem, 

that sound recording has been requested running autornat j ca iiy checks said second subsystem to see if a 

said second subsystem to make a sound recording; 55 reCQrdi|lg previously was made for said requested 

when said first user interface element indicates that ^ by ^ internal control variable inside the 

an image capture has been requested, running said C01rt TOUer or the status of a record waiting indicator, 

first subsystem to capture a requested image; 13 In an imagc capture apparatus, an image capture 

after running said first subsystem, automatically method , comprising: 

checking said second subsystem to see if a sound 60 apparatus is requesting 

recording previously was made for said requested encaang u> 5CC " ™ 

. capturing an image, 

image; and 0 . . . , 

when said second subsystem indicates that no sound when no image capture has been requested: 

recording was previously made for said requested checking to see if the user is requesting to record ^und, 

image automaticaUy making a sound recording 65 when no sound recording has been requested, recheck- 

fcTsaid requested image with said second sub- ing to see if the user is requesting capturing an 
system. 
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when a sound recording has been requested, making a 

sound recording; 
when an image capture has been requested, capturing a 

requested image; 
after capturing an image, automatically checking to see 

if a sound recording previously was made for said 

requested image; and 
when no sound recording was made for said requested 

image, automatically making a sound recording for 

said requested image. 



10 



14. A method according to claim 13 wherein the image 
captured is a single picture. 

15. A method according to claim 13 wherein, in the step 
of automatically checking to see if a sound recording 

s previously was made for said requested image, the auto- 
matic checking is performed by checking an internal control 
variable inside the controller or the status of a record waiting 
indicator. 
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